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Background 

The  Maintenance  Quagmire 

Maintenance  of  software  intensive  systems  is  in 
a  quagmire  and  is  influenced  by  social-technical 

issues  (Northrup,  et.ai.,2006),  developmental 
frameworks  (sheard,  1997),  and  the  fact  that 
software  evolves  (Pfleegerand  Atlee,  2006) 

The  Maintenance  Problem 

The  maintenance  problem  is  the  knowledge 
gap;  the  delta  between  the  knowledge  available 
and  the  knowledge  required  to  resolve  a 

maintenance  problem 


The  Maintenance  Problem 

•  Is  costly:  -half  of  the  maintenance  effort  is  spent 
understanding  the  problem  (Pfieegerand  Atiee,  2006) 

•  Is  compounded  by  documentation  and  operating  procedures 
that  are  non-existent,  incomplete,  or  outdated 

•  Communication  once,  F2F,  now  has  a  myriad  of 
communication  channels  to  include  IP,  RF,  and  satellite 
communication  to  all  corners  of  the  globe 

Response  bv  the  Individual  and  Organizations 

[Maintained]  have  become  part  historian,  part  detective,  and 
part  clairvoyant  (Condi,  1989) 

Inverse  Peter  Principle  'People  rise  to  an  organizational  position 
in  which  they  become  irreplaceable,  and  get  stuck  there 

forever'  (Boehm,  1981) 


The  Paradigm  Shift 

System  maintenance  is  plagued  by  the  knowledge 
gap  and  currency/relevance  of  the  knowledge.  In 
response  to  the  knowledge  gap,  the  community 
of  maintainers  has  to  tackle  the 

maintenance  problem.  The  normative  behavior  of 
the  community  of  system  maintainers  is 
experiencing  a  from  a  culture  of 

need-to-know,  a  practice  that  restricts  the 
information  flow,  to  a  culture  of 
that  puts  the  information  and  potential  knowledge 
in  an  open  forum  for  public  consumption  in  a 
form  of  lass  Collaboratipi  that  enables 

Knowledge  to  :low. 


Architecture  for  Maintenance 

Support  ^ 

How  the  work  gets 

done 


The  Published  Process  for  an 
Ultra  Large  DoD  Organization 


User  Identified 
Failure 


User 

U  n  Corrected 
Failure 


System  Administrator 
identified  fault 
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Four  Separate  Processes 

•  Tier  I  support  14  (steps) 

•  Tier  1 1  Support  12 

•  Tier  III  (>3  days  old)  15 

•  Tier  III  (>7  days  old)  15 

42  steps  for  advance  technical  or 
managerial  support  (Tier  1 1 /1 1 1 ) 


Problem  Resolved  1 


Problem  Resolved 


Problem  Unresovled 
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The  Process  for  an  Ultra  Large 


DoD  Organization 
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Cost  of  Customer 
nteraction  Support 


Assisted  Support 
$250/case1 for  Tier  I 


40%  of  Tier  1 1 /1 1 1  remain 
unresolved  due  to  funding2 


■'■Consortium  for  Service  Innovation 
2Software  Engineering  Center 


Problem  Resolved  1 


Problem  Resolved 


Problem  Unresovled 


No  name  18 


Community  Sourced  Knowledge: 

Mass  Collaboration  . 

The  Alternative 


Bridge  the  Knowledge  Gap: 
Eliminating  the  Blind  Spots 

Have  the  conversation  with  the  extended 

Community  (Denning  &  Dunham,  2010) 

Connect  the  people  that  have  an  interest  in 
your  operating  environment 


Develop  a  maintenance  support  structure  that 
is  Flat  or  Federated  vs.  Hierarchal 


Mass  Collaboration 


One  to  Many  :  Many  to  One 

One  Information  Request  is  "Pushed"  to  all 
subscribers 

Community  members  self  select  what  they  will 
respond  to  based  on  their  expertise  and  level 
of  interest 


Broadcast  or  net-call  to  all  subscribers 


inflow  of  unresolved  Naname  B 


The  Current  Process  -  Hierarchal 


Europe  -Theater 
Network  Operations 
Security  Center  (E- 
TNOSC)  conducts  NetOps 
activities  required  to 
support  BCT. 
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How  Responsive  is  the  Community? 

How  fast  are  they? 


They  do  it  really  Fast 


51%  of  the  responses  are  within  1  Hour 
99%  of  the  responses  are  within  48  Hours 


Time  to  Respond 

60  120.00% 


0  0.00% 
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54%  Reported  savings  of  3-4  Hours  over  other  options  (hours  saved) 
43%  Reported  saving  1-2  Days  over  other  options  (days  saved) 


What  does  the  Community  do? 


What  type  of 
problems  do  they 

solve? 


They  Satisfice*  Problems  and 
Reduces  Complexity 

They  mash  up  problems  with  solution  that  reduces 
the  complexity 

•  72%  Fully  Resolved,  Reduced  to  Type  I 

•  79%  Complexity  Reduced  to  Type  I  or  II 


Categorization 
of  problems 

Known  Solution 

Unknown 

Solution 

Known  Problem 

Type  1 
(Tier  0  or  1 ) 

Type  II 
(Tier  11/ III) 

Unknown 

Problem 

Type  III 
(Tier  1 1  / 1 1 1 ) 

Type  IV 
(Tier  III/  Wicked) 

12%  to  19%  improvement  over  the  60%  SEC  resolution  rate 
*Simon,  1996 


How  effective  is  the  process 


What  type  of  help 
are  you  going  to  get? 


Experts  and  Expertise 

Informants  were  asked  to  rate  the  quality  of  the 
dialogue/ response. 

83%  reported  that  they  provided  expert*  advice 
(does  everyone  think  they  are  an  expert?) 

77%  of  those  who  received  the  information 
classified  the  response  as  expert  knowledge 

*An  expert  was  defined  to  the  respondents  as 
someone  who  has  special  skills,  talent, 
knowledge  or  know-how  in  the  domain  in 
question 


Who  are  the  experts? 

one  thousand  members  of  a  community 
sourced  knowledge  group 


Answer  Options 

Executive 

Senior  Supervisor,  Manager .  .  . 
Senior  Professional/Analytical.  .  . 
Senior  Scientific,  Engineering  .  .  . 

Mid  Level  Supervisor,  Manager.  .  , 
Middle  Professional/Analytical.  .  . 
Mid  Level  Scientific,  Engineering, 
unior  Supervisor,  Manager .  .  . 
unior  Scientific,  Engineering.  .  . 
dministrative  staff 
Special  staff 
Support  staff 

Student 

Retired 

Other 


Response  Percent  Response  Count 


44% 

Senior  or 


268 


Resource  Comparison 


Comparison 

Community 

Sourced 

Knowledge 

Cost 

<$1  per 
member 

Problem 

Solvers 

Experts 

Resolution  Rate 
(typeJ.1  or  III) 

72-79% 

Time  to 
Respond 
(type Tl  or  Pi  Tj 

50%  w/  in  1  hour 
avg  6  responses 

Hierarchal 

Support 

Structure 


$230  per  incident 
(Tier  I  support) 


Novice  (Tier  I )  until 
escalated 


60% 


No  data  available 
(Data  ^col 

bydh‘  3-4  hours 
to  1-2  days 


Summary 

•  Create  an  architecture  that  is  people  centric 

•  Capitalize  on  the  knowledge  base  that  resides  in 
the  community 

•  Dialogue  is  not  limited  to  traditional  organizational 
boundaries 

•  Focus  on  fixing  the  problem,  not  indentifying  fault 

•  Discussions/dialogue  are  with  impunity 

The  result  is  a  faster,  expert 
informed  community,  with  more 
time  for  action  ana  less  time 
searching  for  understanding  at  an 
almost  zero  cost  to  stakeholders 
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